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ABSTRACT 

The  effect  of  camera  rotation  on  the  description  of  optical  (low  is  analyzed  The 
transformation  law  of  the  parameters  is  explicitly  given  by  considering  infinitesimal  gen¬ 
erators  and  irreducible  reduction  of  the  induced  representation  of  the  3D  rotation  group. 
The  parameter  space  is  decomposed  into  invariant  subspaces,  and  the  optical  flow  is  ac¬ 
cordingly  decomposed  into  two  parts,  from  which  an  invariant  basis  is  deduced.  A  pro¬ 
cedure  is  presented  to  test  the  equivalence  of  two  optical  flows  and  to  reconstruct  the 
necessary  amount  of  camera  rotation.  The  relationship  with  the  analytical  expressions 
for  3D  recovery  is  also  discussed. 
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1.  INTRODUCTION 


Recovery  of  3D  structure  and  motion  from  a  2D  image  sequence  is  one  of  the  most 
challenging  problems  in  computer  vision.  Most  existing  schemes  are  classified  into  two 
types.  One  is  the  correspondence-based  approach,  which  does  not  assume  any  particular 
model  of  the  object  except  the  rigidity  of  motion  and  uses  point-to-point  correspondence 
explicitly.  The  3D  structure  and  motion  are  recovered  numerically  [1-5].  Another  is  the 
flow-based  approach,  which  employs  a  specific  model  of  the  object  and  pays  attention  to 
global  characteristics  of  the  optical  flow  such  as  vanishing  points  [6-9].  This  idea  is  fully 
developed  by  Kanatani  [10-12];  if  the  object  is  a  plane,  the  3D  structure  and  motion  are 
given  analytically  in  terms  of  invariants  with  respect  to  coordinate  changes  on  the  image 
plane.  These  invariants  are  derived  by  means  of  irreducible  reduction  of  the  2D  rotation 
group. 

Although  the  flow-based  approach  does  not  make  use  of  point-to-point  correspon¬ 
dence  explicitly,  the  optical  flow  itself  is  usually  obtained  by  detecting  the  point-to-point 
correspondence  between  two  successive  images,  and  this  correspondence  detection  is  a 
time  consuming  process  [13-17],  Kanatani  [18-20]  proposed  schemes  which  do  not  use 
the  correspondence  when  the  object  is  a  planar  surface.  In  this  paper,  we  first  summar¬ 
ize  the  analytical  results  of  Kanatani  [10-12]  and  then  generalize  Kanatani’s  schemes 
[18-20]  so  that  those  analytical  results  can  fit  in  the  present  new  setting. 

2.  3D  MOTION  FROM  FLOW  PARAMETERS 

We  assume  that  the  image  under  consideration  is  decomposed  into  planar  or  almost 
planar  regions,  say  by  the  method  discussed  by  Kanatani  [10,11],  Now,  attention  is  paid 
to  each  region  regarded  as  planar.  Take  a  Cartesian  xy  -coordinate  system  on  the  image 
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plane  and  the  3 -axis  perpendicular  to  it.  Let  z  =px  +qy  +r  be  the  equation  of  that 
plane.  The  coefficients  p  and  q  are  the  components  of  the  gradient  of  the  plane,  and  r 
represents  the  absolute  depth  from  the  image  plane.  Let  (0,0,r  /,  the  intersection  between 
the  plane  and  the  3-axis,  be  a  reference  point  (Fig.  1).  The  instantaneous  rigid  motion 
is  specified  by  translation  velocity  (a,b,c)  at  the  reference  point  and  rotation  velocity 
(uq.u/j.uAj)  screwwise  around  it  (i.e.,  with  rotation  axis  orientation  (wj,u/2,u.'3)  and  angular 
velocity  yj (rad/sec)  screwwise  around  it).  Hence,  our  goal  is  to  reconstruct 
the  nine  structure  and  motion  parameters  p  ,  q  ,  r  ,  a  ,  b  ,  c  ,  oj1,  and  w3  from  observa¬ 
tion  of  the  projected  image  motion 

(1)  PERSPECTIVE  PROJECTION 

Let  (0,0,-/  ),  the  point  on  the  z -axis  at  distance  /  from  the  image  plane  on  the 
negative  side,  be  the  viewpoint  or  focus  of  the  camera.  A  point  (X  ,Y  ,Z)  in  the  scene  is 
projected  to  (/ X /(/  +Z),f  Y /(/  +Z ))  on  the  image  plane.  If  the  point  is  on  the  plane 
z  —px  +qy  +r  which  is  moving  as  described  above,  it  is  easy  to  show  that  the  following 
optical  flow  is  induced  at  point  ( x  ,y  )  on  the  image  plane: 


u  =u  o+Ax  4-  By  +(Ex  +Fy  )x  , 


v  —v0+Cx  +Dy  +(Ex  +Fy  )y 


where  eight  flow  parameters  are  given  by 
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In  other  words,  what  we  are  viewing  is  a  very  restricted  form  of  motion  whose  velocities 
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are  specified  only  by  eight  flow  parameters  u0>  vo>  A,  B,  C,  D,  E  and  F.  If  these 
parameters  are  the  same,  the  motions  seem  identical  to  the  viewer.  Thus,  our  procedure 
is  divided  into  two  stages.  First,  we  detect  the  flow  parameters  u0,  v0,  A  ,  B ,  C ,  D  ,  E 
and  F  from  a  given  image  sequence.  Next,  we  compute  the  structure  and  motion 
parameters  p  ,  q  ,  r,  a,  b  ,  c,  Wj,  and  u;3  from  these  flow  parameters.  The  second 


stage  is  performed  by  solving  the  non-linear  simultaneous  equations  (2.2)  as  follows 
(Appendix  A):  First,  compute 


a 


U0=u0+iv0  T  =A  +D ,  R=C-B, 
S=(A-D)+i(B+C),  K=E+iF, 


13 


,a 

•2 


where  i  is  the  imaginary  unit.  Hence,  U0,  K  and  S  are  complex  numbers.  If  we  put 
V  ~a  +ib  ,  P  =p  +iq  and  IV  =w1+iwo,  then  V ,  c  ,  P  and  w3  are  given  by 

V={f  +r  )U0/f  ,  c=(f+c)c>, 

P{c,)=-~{fK-UJf  ±\J(f K-U o/ /  f-lc’S  ), 

W(c')=±(fK-U0/f  ±y/{fK-U0/f  )Uc'S  )+iUJf  ,  (2.4) 

*3(c')=UR+Re[P(c')(\V(cr+tUZ/f  )]), 


i5 
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c'=-i(r+Im!P(c')(  W(c'Y+iUo  //)]),• 


where  Re[.j  and  ImJ.j  denote  the  real  and  the  imaginary  part  respectively  and  *  the  com¬ 
plex  conjugate.  Here,  P ,  IF  and  u j3  are  functions  of  c',  and  c'  is  given  by  solving  the 
last  of  eqns  (2.4).  There  exists  only  one  non-zero  solution  c'.  In  fact,  if  we  substitute 
the  expressions  for  P(c')  and  H"(c/)  in  it,  the  equation  reduces  to  a  cubic  equation  in  c' 


(Appendix  A).  Since  an  explicit  form  of  the  solution  of  a  cubic  equation  exists,  we  can 
express  the  solution  c '  explicitly,  although  in  in  a  complicated  form,  if  %ve  wish.  How¬ 
ever.  application  of  an  iteration  scheme  seems  more  feasible.  In  any  case,  the  problem  is 
completely  solved  analytically,  and  we  find  that  (i)  the  absolute  depth  r  is  indeter¬ 
minate,  (ii)  a  /(/  4-r),  6 /(/  +r  )  and  c  /(/  +r )  are  uniquely  determined,  and  (iii)  there 
exist  two  sets  of  solutions  for  p  ,  q  ,  ut,  and  u;3,  one  being  true  and  the  other  spurious. 
However,  the  spurious  solution  disappears  if  two  or  more  planar  regions  of  the  same 
object  are  observed  because  colt  ww  and  cj3  must  be  common  to  them.  Numerical  schemes 
of  3D  recovery  from  point-to-point  correspondence  have  been  known  [2-4]  and  the 
existence  of  the  spurious  solution  was  pointed  out  [9],  but  analytical  expressions  like  eqns 
(2.4)  have  not  been  known. 


(2)  ORTHOGRAPHIC  APPROXIMATION 

If  we  take  the  limit  /  — *oo  of  a  large  focal  length  /  in  eqns  (2.2),  we  obtain  the 
following  orthographic  approximation: 


u0=a  , 


v0=6  , 


A  — ■ p  Wo ,  B  — g  Wo- cc3,  C  — — p  uq~l-co3,  D  — —g  u,q, 


E=  0, 


F  =0, 


and  the  solution  is  explicitly  given  as  follows  (Appendix  B): 


V'  =  {'o,  « :3~(R±VSS,-T- 


P  =-jC\pi{~— i-arg(5)+-i-arg(2^3-(/?  +»T))),  (2.6) 

lP=A:expj  (.l+JLarg(S)— i-arg(2^3-(/?  i-iT  ))), 
where  arg  denotes  the  argument.  Here,  k  is  an  indeterminate  scale  factor.  Thus,  (i)  the 


absolute  depth  r  and  the  velocity  c  in  the  .r -direction  are  indeterminate,  (ii)  an  indeter¬ 
minate  scale  factor  k  is  involved,  and  (iii)  there  exist  two  types  of  solutions,  one  being 
true  and  the  other  spurious.  However,  the  spurious  solution  disappears  if  two  or  more 
planar  regions  of  the  same  object  are  observed  because  uq,  w2  and  uj3  must  be  common  to 
them.  3D  recovery  from  point-to-point  correspondence  under  orthographic  projection 
was  first  studied  by  Ullman  [2],  and  the  fact  that  an  indeterminate  scale  factor  is  neces¬ 
sarily  involved  was  already  pointed  out  [5].  However,  analytical  expressions  of  the  solu¬ 
tion  have  not  been  known. 


(3)  PSEUDO-ORTHOGRAPHIC  APPROXIMATION 

If  we  omit  terms  of  0(1//  ’)  but  retain  terms  of  0(1//  )  in  eqns  (2.2),  E  and  F 
are  replaced  by 

E=u.,/f,  F=-wl/f  ,  (2.7) 

respectively,  which  we  call  the  pseudo-orthographic  approximation.  The  solution  is 
analytically  given  as  follows  (Appendix  C): 

V=(f +r)UJf  ,  W  =if  K ,  P=  -S 

JE  -UQi  J 

~'3=}(K  +ImjSe -*“]),  c  =-I±!(r-RejSe-2’“]),  (2.8) 

Q=arg(  /  K  -  U0f  f  ). 


Hence,  (i)  the  absolu  e  depth  -  is  indeterminate,  (ii)  a  /(/  +r  ),  6  ( /  —  r  )  and  c  (/  -*-r  ) 
are  uniquely  determined,  and  (iii)  p  ,  q ,  uq,  w2  and  u j3  are  uniquely  determined.  It  should 
be  noted  that  no  spurious  solution  exists. 
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coordinate  rotation  by  9  on  the  image  plane  as 


T  ->  T,  R  — ►  /? , 

U0  —  U0e~ia,  K  -  Ke'f,  (2.9) 

S  -  Se--6. 

(see  Appendix  D.)  In  other  words,  T  and  R  (as  well  as  r  ,  c  and  u.':!)  are  (absolute) 
invariants  of  weight  0  (or  scalars),  U0  and  K  (as  well  as  l',  P  and  IF)  are  (relative) 
invariants  of  weight  -1  (or  vectors),  and  5  is  a  (relative)  invariant  of  weight  -2  (or  a  ten- 
sor)\V2}. 

3.  FLOW  PARAMETER  ESTIMATION  BY  FEATURES 

Let  X(x,y)  represent  the  image.  For  example,  if  the  image  consists  of  gray-le.els, 
X(x,y)  denotes  its  intensity  at  point  (x  ,y).  If  the  image  consists  of  colors,  A'(x,y) 
may  be  a  vector  valued  function  corresponding  to  R,  G  and  B.  If  the  image  consists  of 
points  and  lines,  A'(x,y)  has  delta-function-like  singularities.  In  any  case,  we  define  a 
feature  of  image  X(x  ,y)  as  a  functional,  i.e.,  a  map  F(.)  from  the  set  of  images  X{x  ,y) 
to  the  real  numbers. 

Suppose  that  there  is  an  optical  flow  u(x.y),  v(x,y)  on  the  image  plane  and  that 
the  image  is  moving  according  to  this  flow.  Then,  if  X(x  ,y  )  is  an  image  at  time  t  ,  it 
changes  at  time  t  —6t  after  a  short  time  interval  into 

A'(j  - u  (x  ,y  )6t  ,y-v(x  ,y  )St ) 

=  A'(j  .y  )— rr~u  (x  ,y)6t  -~-v(x  ,y)6t  4-  ■  (3.1) 

ox  oy 

Then  a  feature  F  X\  at  time  t  changes  at  t  -~6t  into  F  X  J-DF  X  Ft  —  ■  ■  ,  and  the 

change  rate  D F  .  is  in  general  a  linear  "unctional  in  u(x.y)  and  c(j  ,y  ). 


In  view  of  the  optical  flow  of  eqns  (2.1),  this  means  that  we  have  a  linear  equation 


of  the  form 

DF[A'!=C1[A>i)+C2[A>o+  '  •  +  C'7(A']F+<78[A'|F,  (3.2) 

where  Cj[.J,  ....  C8[.j  are  functionals  derived  from  the  given  feature  functional  F[.j,  so 
that  they  are  all  known  functionals.  On  the  other  hand,  the  change  rate  DF  [.]  of 
feature  F  {.}  can  be  estimated  by  difference  schemes.  For  example,  observe  the  image  at 
time  t  and  compute  feature  F(t).  Next,  observe  the  image  at  time  t  +bl  after  a  short 
time  interval  and  compute  the  same  feature  F(t+6t).  Then,  the  time  change  DF[Ar]  is 
approximated  by  (F(t  -\-8t  )-F (t  ))/6t ,  or  we  can  use  a  higher  order  numerical 
differentiation  scheme  if  observations  are  made  on  three  or  more  consecutive  images. 
Thus,  all  quantities  except  u0,  v0,  A  ,  B ,  C ,  D ,  E  and  F  in  eqn  (3.2)  are  directly  com¬ 
puted  from  an  image  sequence  without  requiring  point-to-point  correspondence.  Since 
an  equation  of  the  form  of  eqn  (3.2)  provides  a  linear  constraint,  we  obtain  a  set  of 
simultaneous  linear  equations  to  solve  for  the  flow  parameters  u0,  n0,  E  and  F  if  we 
provide  eight  or  more  independent  feature  functionals  FJ.],  F2(.],  ...  . 

The  idea  of  using  feature  functionals  was  suggested  by  Amari  [21,22]  and  was 
applied  to  3D  recovery  by  Kanatani  [18-20] .  However,  he  did  not  divide  the  computa¬ 
tion  process  into  two  stages  as  described  here  but  tried  to  compute  the  structure  and 
motion  parameters  p,  q.  r,  a,  6.  c,  u.’2  and  u,’3  directly.  This  leads  to  a  set  of 
simultaneous  non-linear  equations  which  are  difficult  to  solve.  He  proposed  an  iterative 
scheme  which  traces  the  motion  along  time,  starting  from  known  initial  values  of  p  .  q 
and  r  as  described  later  Here,  however,  the  process  is  divided  into  two  stages.  We  first 
estimate  the  flow  parameters  by  solving  a  set  of  linear  equations.  This  poses  no  compu¬ 
tational  problem  Then,  the  structure  and  motion  parameters  are  computed  in 


-  ..  »V  ■-  ,  •  •-  -  .*» 
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analytical  terms  as  described  in  the  previous  section. 

As  for  the  feature  functionals,  we  can  use  those  used  by  Amari  [21,22]  and  Kana- 
tani  [18.20].  We  review  and  modify  them  so  that  they  fit  in  the  present  new  setting. 

(1)  ANISOTROPY  OF  TEXTURE 

Consider  a  surface  which  has  a  spatially  homogeneous  (but  not  necessarily  isotro¬ 
pic)  texture  consisting  of  line  segments.  The  3D  structure  and  motion  are  detected  by 
checking  the  anisotropy  of  the  texture.  This  method,  applicable  in  the  case  of  ortho¬ 
graphic  projection,  was  first  suggested  by  Witkin  [23]  and  combined  with  integral 
geometry  or  stereology  by  Kanatani  [18] 

Let  the  line  texture  on  the  image  plane  be  dissected  into  infinitesimal  line  elements. 
The  orientation  of  each  line  element  is  specified  by  angle  0  from  the  j-axis  Since  there 
are  two  angles  for  the  same  orientation,  i.e . ,  9  and  0~ ir  designate  the  same  orientation, 
we  choose  one  of  them  randomly  with  a  probability  of  1/2.  Let  the  distribution  density 
f  (0)  be  defined  in  such  a  way  that  /  (0)d0  is  the  summed  length  of  those  line  segments, 
per  unit  area,  whose  orientations  are  between  6  and  9+d6.  By  definition, 
c0= j^f  (0)d6  is  the  total  length  of  the  line  segments  per  unit  area  If  the  distribution 
is  isotropic.  /  (0)  is  constant  for  all  9.  If  the  distribution  is  nearly  isotropic,  the  distribu¬ 
tion  dentity  /  ( G )  is  approximated  by  a  Fourier  series  up  to  the  second  order 

/  (0)=-^—  [l-i-a-jCos2/?4-6.jsiri2/?!. 

co=fnf(9)d0 ,  (3.3) 

J  o 

ao=—  ['*  f  ( 0)eos20d  0,  6.,=  —  f~*  f  (0)snv20d0 

'  c 0  o  '  CD  " 


Here,  first  order  terms  do  not  appear  because  of  the  symmetry  /  {9~  /  (tf). 


If  the  image  is  changing  according  to  orthographic  optical  How  (i.e.,  ecpis  (2.1)  with 
E —0  and  F=  0),  the  Fourier  coefficients  c0,  a2  an(J  ^2  of  eflns  (3.3)  change  as  follows 
18.29,30]: 


D 


c0 

I 

a 

= - 

bo 

4 

_  ”  _ 

co.  <i 

i  and  bo 

c0(a  c0b2  c2bo  -c0{a.,~2) 

-a o' +6  1)  -6o(a.>* -r-4)  u2" -6 

—  (lob  o  —6  ■>'  ~--l  (i  ofh  —b-“  t-4  a  (>  ti  ob  o 


(3,1) 


although  another  feature  must  be  added  to  determine  A  ,  B  C  and  D  uniquely. 


In  order  to  measure  c0,  a ■>  and  bo  from  a  given  image,  we  must  estimate  the  distri¬ 
bution  density  /  (0)  from  the  histogram  of  line  segment  orientations.  To  this  end.  we 
must  choose  an  appropriate  class  interval  for  the  histogram.  If  it  is  too  large,  estimation 
becomes  crude.  If  it  is  too  small,  the  counting  for  each  class  is  greatly  affected  by  noise. 
This  difficulty  arises  because  the  definition  of  the  distribution  density  /  (0)  involves 
infinitesimals,  i.e.,  a  limit  taking  process. 

There  exists  a  method  of  estimating  the  distribution  density  /  ( 0 )  which  does  not 
involve  a  limit  taking  process.  This  is  possible  by  a  stereolo/jical  technique.  Instead  of 
making  a  histogram,  we  count  the  number  of  intersections  between  the  line  segments 
and  a  probe  line  (or  equally  spaced  parallel  scanning  lines).  Let  .Y(0)  be  the  number  of 
intersections  per  unit  length  of  the  scanning  line  of  orientation  0  Then,  the  observed 
intersection  count  A! (0)  is  related  to  the  distribution  density  /  (0)  by  what  Kanatani  18. 
30  called  the  (two-dimensional)  Bujjon  transform  : 

.V(0)=fT|sin(0-0')i/(0')</0'  (331 

J  o 


If  the  distribution  density  /  (0)  is  given  by  eqns  (3  3).  the  intersection  count  ,Y|0] 
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becomes  18.  30 


where 


C'o, 


X  (0)=  — pjl+H  .,cos20+fiosin20], 
Co-/"/  (0)d0, 


.4  o=  — - —  /  X (0)cos'20d  9,  B,=— f  N(0)sm20d  0 


C0J  o 


ffl'  0 


C  n- - 1  Cn,  A  — - CL  o,  B  o — - 6  o. 

0  0.  3  *  3  * 


(3.6) 


(37) 


Hence,  we  can  use  C  q,  An  and  B *  themselves  as  feature  functionals  They  are  computed 
by  measuring  the  intersection  count  X (9)  and  approximating  the  integrations  of  ec;ns 

(3  6)  by  appropriate  summations.  For  example,  putting  A*  =X(rrk  / X),  k  =0,1 . Ar-1. 

we  may  adopt  the  approximation 

C=  2‘S^/iV, 

k  =0 

(3.8) 

i 

Xk. 

k  =0  iV  *=0  *=0  JV  k-0 

Consider  Fig  3,  for  example.  If  we  draw  on  it  equally  spaced  parallel  scanning  lines 

whose  spacing  is  1  22  of  one  side  of  the  square  frame  for  orientations  Ok—zk  16. 
k  =0,1...  ,16  with  A' =  16.  i.e..  at  11.25°  intervals,  we  obtain  the  intersection  count  as 
shown  in  Fig.  1.  from  which  we  obtain  A  ..=-0  172  and  /?  .,=0.068.  The  solid  curve  is 
the  corresponding  approximation  of  eqns  (3.6).  Fig  5  is  the  recovered  distribution  den¬ 
sity  of  eqns  (3  3)  estimated  by  using  eqns  (3  7). 

From  eqns  (3.6)  and  (3  10),  the  change  rates  of  .4  ..  and  B ■>  become  ns  follows 


N-l  ;V  -l 

A  2=2  E  Nk  cos -XX- f 


,v-l 


E  'Yt  .  B,=-2  E  A* sin 


2nk 


E 


(3.9) 


"Co” 

D  A  o 
B, 


-C0(j4o+-jj-)  -C0B  2 


C0Bn  C0(.42-y) 


- J  Bn{An+—)  Bn{A  2~j)  -.422+-j 

A  2B  2  B  %  ~—A  % — “  B  n — Ao-—  -A2Bo 

3  3  *  3  “  3 


(2)  ANISOTROPY  OF  CONTOUR 

In  the  above,  we  assumed  spatial  homogeneity ,  since  anisotropy  is  expressed  per 
unit  area.  This  assumption  assures  that  the  portion  of  the  texture  newly  coming  into 
view  has  the  same  statistical  characteristics  as  the  portion  of  the  texture  going  out  of 
view.  However,  this  assumption  is  not  necessary  if  the  entire  planar  region  is  viewed, 
i.e.,  if  we  can  always  identify  the  planar  region  that  we  are  looking  at.  Then,  the  distri¬ 
bution  density  /  ( 9 )  is  defined  in  such  a  way  that  /  (0)d  9  is  just  the  summed  length  (not 
per  unit  area)  of  those  line  segments  whose  orientations  are  between  0  and  9+d0.  By 
definition,  c0=J0"T/  (6)d0  is  the  total  length  of  the  line  segments.  If  the  distribution  is 
isotropic,  /  (9)  is  constant  for  all  9.  If  the  distribution  density  f  (9)  is  approximated  by 
the  Fourier  series  (3.3)  up  to  the  second  order,  the  change  rates  of  c0,  a2  and  60  are 


given  by  eqn  (3.4)  except  that  the  first  row  of  the  matrix  is  replaced  by 


c0(a2+2)  c06  0  c06  o  -c0(a2-2).  (3.10) 

If  we  count  the  number  of  intersections  between  the  texture  of  the  entire  planar 
region  in  question  and  a  probe  line  (or  equally  spaced  parallel  scanning  lines),  and  if 
.V (9)  is  the  number  of  intersections  per  unit  length  of  the  scanning  line  of  orientation  9. 
then  X(0)  and  /  (9)  are  again  related  by  the  Bufion  transform  of  eqn  (3.5).  Hence,  if  the 
distribution  density  is  approximated  by  eqn  (3.3),  N(0)  is  given  by  the  form  of  eqn  (3.G), 
and  the  change  rates  of  C0,  A  2  and  B2  are  given  by  eqn  (3.9)  except  that  the  first  row 
of  the  matrix  is  replaced  by 


-V\'v 


(3  11) 


-C^A  2-|)  -C0B,  2C0(A2+|). 

An  interesting  application  arises  when  the  planar  region  has  no  texture  but  its  con¬ 
tour  is  viewed.  Then,  the  contour  itself  can  be  regarded  as  a  texture.  If  the  contour 
shape  is  convex,  the  intersection  counting  is  equivalent  to  measuring  the  diameter  D  {0) 
defined  as  the  spacing  of  two  parallel  lines  of  orientation  0  tangent  to  the  contour  (Fig 
6),  for  every  line  has  two  intersections  if  they  exist  (excluding  the  exceptional  case  of 
tangency).  The  contour  shape  need  not  be  convex  if  the  diameter  is  measured  from  out¬ 
side,  for  in  this  case  the  convex  hull  of  the  contour  plays  the  role  of  a  texture.  The  con¬ 
vex  hull  is  invariant  with  respect  to  projection;  the  convex  hull  of  a  projected  contour  is 
the  same  as  the  projection  of  the  convex  hull  of  the  original  contour.  The  diameter  D  (0) 
and  the  distribution  density  /  (0)  of  the  contour  are  related  as  follows  [19j: 

D(0)=yym(d-ff)\f(ff)d(/  (3.12) 

If  this  function  is  expressed  in  Fourier  series  as  in  eqn  (3  6),  the  coefficients  C0,  A2 
and  Bo  change  as  in  eqn  (3.9)  with  the  first  row  replaced  by  (3  11).  Consider  the  two 
contour  images  C  and  C1  of  Fig.  7,  for  example.  The  diameters  measured  at  10°  inter¬ 
vals  of  orientation  are  plotted  in  Fig.  8,  where  the  white  circles  correspond  to  C  and  the 
black  ones  to  C.  The  solid  curves  are  approximations  of  the  form  of  eqn  (3.6)  with  C , 
A  2  and  B 2  computed  by  eqns  (3.8),  indicating  that  they  fairly  well  characterize  the  data. 

(3)  FILTERING  GRAY-LEVEL  IMAGES 

Suppose  we  are  observing  a  sequence  of  grav-level  images  of  a  planar  region  Amari 
21,  22;  suggested  the  use  of  filtering  or  weighted  averaging  for  feature  detection 
Namely,  we  use 
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F  t-Y]=//,v  m  (*  >y  )-v  (*  >y  )dxd,J  . 


(3.13) 


as  a  feature,  where  m(x,y)  is  a  fixed  weight  function  of  the  filter,  and  integration  is 
done  over  a  fixed  domain  or  window  IK  on  the  image  plane.  Suppose  the  area  of  non¬ 
zero  gray-levels  is.  localized  in  the  window  IK  so  that  X(x,y)=0  along  the  window 
boundary  and  suppose  the  gray-level  does  not  depend  on  the  gradient  or  the  depth  of 
the  object  surface.  An  example  is  letters,  lying  entirely  in  the  window  IK,  drawn  on  a 
white  (or  black)  object  surface. 

If  the  image  X(x,y)  changes  according  to  eqn  (3.1),  the  feature  F\X\  becomes 
after  a  short  time  interval  6t 


ffw  m  (x  <y  )dxdy -ffw  m  (x  ,y  )(-|j«  (z  >y  (x  ’y  ))6tdxd,J  + 

=^!-V]  +fJw(^+^)X6tdxdy+-.-, 


(3.14) 


where  we  performed  integration  by  parts,  setting  integrals  along  the  window  boundary 
to  be  zero  according  to  our  assumption  that  X(x,y)  is  zero  at  the  window  boundary. 
Thus,  the  change  rate  DF  (A’  j  of  the  feature  FLY]  is  given  by 


(3.15) 


When  the  optical  flow  is  given  by  eqns  (2.1),  functionals  0 1  [.],  ...,  C8[.]  of  eqn  (3.2) 


become 


C'ii-Yi =/  fw  mx  Xdxdy ,  C’.,jA'j=J  Jw  rny  Xdxdy  , 
c 3{X}=f  Jw(m  +xmx  )Xdxdy  ,  C 4{X ]=//„,  ymx  Xdxdy  , 
Cb\X  }=Jfw  xmy  Xdxdy  ,  C6[A'  ]=//((r  ( m  +ymy  )Xdxdy  , 
C'7iA'j=  f  fw(3xm  +x  ~mz  +njmy  )Xdxdy  , 


(3.16) 


!W 


Cf 


c’8[-X']=//,K(3ym  +xymx  +y  -mll  )XJxdy  , 

where  mx—dmjdx  and  my=dm  /dy  are  known  functions.  Thus,  C  x  (.],  C8j.j  can 

be  implemented  as  filters.  Here,  we  assumed  that  A'(:r,t/)=0  at  the  window  boundary. 
This  assumption  is  not  essential,  and  it  can  be  removed.  Instead,  the  expressions  of  the 
functionals  Cj[.],  ....  C8[.]  include  terms  of  line  integral  along  the  window  boundary 

(4)  INTEGRATION  ALONG  AND  INSIDE  THE  CONTOUR 

Kan  at  an  i  [20]  considered  the  case  where  only  the  bounding  contour  of  a  planar 
region  is  observed.  He  proposed  the  use  of  integration  along  the  contour  C  of  a  given 
fixed  function  m(x,y), 

F\X}=*Jcm(x  ,y)ds ,  (3.17) 

as  a  feature,  where  ds  denotes  the  line  element  along  the  contour  C .  This  integration  is 
easily  performed  on  the  image  by  using  a  scheme  of  numerical  integration  [20],  Then. 


we  see  that 


DF  LY 


r  r  dm  dm  ,  ,  du  ,o  .  du  ,  dv »  ,  ,  ,  dv  ,  . 

Jc  +{—y^)x  y  ^-yy  )m  'dS  ’ 


(3.18) 


where  x'=dx  /ds  and  y'=dy  / ds  .  When  the  optical  flow  is  given  by  eqns  (2.1),  func¬ 
tionals  C  j j.J ,  ...,  C g[. ]  of  eqn  (3.2)  become  as  follows: 

C  i  j.Y }=fc  mx  ds  ,  C2[A'  ] = Jc  my  ds  , 

C 3 [ A" j = Jc  \xmz  —x'~m  ids  ,  C 4jA';= fc  j ymz  -t-x'y'm  \ds  , 

\=JC  \xmy  +x'y'm  Jds  ,  G6[A']=/r  j ymy  -r yr:m  \ds  .  (3.19) 

C'-jA'j= J  [x2m,  -* -xymy  +(2xx'2+yx'  y'  +xy'~)m  j  ds  , 
r=fc  [xy"h  +y2,ny  +{yxrl+xx'  y'-2yyr2)m  j  ds. 
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.V.VJV 


Hen  ce,  Cil-l . C,[.J  can  be  computed  on  the  image  plane  by  using  a  scheme  of  numeri¬ 

cal  integration. 

Kanatani  [9]  also  proposed  the  use  of  surface  integration  inside  the  planar  region  5 


F\X\=S  S^m(x  'y)dxdy  < 


(3.20) 


of  a  fixed  function  m(x,y).  Now,  integration  is  done  over  a  moving  region  5,  not  over 
a  fixed  window  If'.  The  change  rate  is  expressed  in  two  ways,  due  to  Green’s  theorem, 
as  follows: 


D F  [AT]=  / /  lu^+v^-+(^L+^)m  ]dxdy 
1  1  JJsi  dx  dy  (  dx  dy’  1  y 

=J  (uy'-vx')mds. 


(3.21) 


When  the  optical  flow  is  given  by  eqns  (2.1),  functionals  Ci(.j,  ....  C8[.j  of  eqn  (3.2) 
become 

C  ll-^l=/c  my'ds  =/  jg  mx  dxdy  ,  C n[AT|=-/c  mx'ds  = / /5  dxdy  , 

C73[A']= fc  xy'mds  =//5  [m  +xmz  \dxdy  , 

C’4pt1=/c  yy'mds  =/ Js  ymz  dxdy  , 

C S[A" ) =-Jc  xx '  rrids  =/ jg  xmy  dxdy  ,  (3.22) 

C 6[X  | =~fc  yx ' mds  =/ Jg  (m  +ymy  | dxdy  , 

C-\X]= Jc  (x'y'-xyx')mds  =J  Js  (3 xm  +r:m1  -+- xymy  dxdy  , 

C'giA'1— jc(xyy'-y-x')inds  =j  Jg  [3 yrn  ~iymx  4- y~my  'dxdy. 

Hence.  C \  . \ .  C8[.]  are  computed  on  the  image  plane  as  either  line  integrals  or  surface 

integrals. 


4.  STEPWISE  TRACING  AND  STEREO 


According  to  the  method  described  so  far,  the  flow  parameters  k0i  t;0,  A  ,  D ,  C , 
D  ,  E  and  F  can  be  extracted  from  two  (or  more)  consecutive  images,  and  then  the 
structure  and  motion  parameters  a  ,  b  ,  c  ,  p  ,  q  ,  ux,  and  u>3  are  determined  by  analyt¬ 
ical  equations.  As  was  shown,  however,  there  remain  certain  indeterminacies  including 
the  absolute  depth  r  .  These  indeterminacies  can  be  removed  if  sequence  of  images  is 
available  and  if  the  initial  position  of  the  surface  is  known  [19,  20].  This  becomes  possi¬ 
ble  if  we  note  the  fact  that  if  a  plane  z  =px  +qy  +r  is  moving  with  translation  velocities 
a ,  b  and  c  and  rotation  velocities  Wj,  ui2  and  ui3  as  described  in  Section  2,  the 
coefficients  p  ,  q  and  r  change  as 


-^•=p<7  w,-(p  2+  l)w2-<7  w3,  -^2-=(  q  2+ 1  )u ix-pq  w2+p  u-3, 

df  , 

_=C  -pa  -qb. 


(4.1) 


Suppose  p  ,  q  and  r  are  known  at  time  t .  Substitution  of  eqns  (2.2)  in  eqn  (3.2) 


yields 


DF\X\=Ct  [X]+C4  [X]+Cc  [Xl+C^W+C^Xl+C^X], 


(4.2) 


where  Ca  (.],  C4  (.],  Cc  [.],  C^J.],  CUt\.}  and  CWj[.]  are  functionals  defined  by 

c.  [•l=7i-(/c’.(]-p^3[-Hc4[.])I  c-*  [.}=-}— (fc2[.\-pcs\.}-qc6\.\), 

J  J  +  r 

^[•]=-j^(C'3[-]+C'6|.]-j(pC'7[.]+9C8[.]))) 

(4.3) 

CUl{.}=-(pCsl.}+^C6[]+jrCs[.\),  C Ui[.\=pC 3[.}+qC s[.]+-j-C 7[.]t 

^U4[]=C'S[.1-C4[.]. 

Since  p  ,  q  and  r  are  known,  Ct  [.],  ...,  CUj[.]  are  known  functionals.  The  left-hand  side 
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of  eqn  (4.2),  i.e.,  the  change  rate  F[XJ  of  feature  F[X\,  is  obtained  by  a  numerical 
differentiation  scheme  as  described  earlier.  Hence,  if  we  use  six  or  more  independent 
feature  functionals,  we  obtain  a  set  of  simultaneous  linear  equations  of  the  form  of  eqn 
(4.2)  to  determine  a  ,  b  ,  c  ,  Wj,  and  u>3.  Then,  p  ,  q  and  r  at  time  t  -\-6t  are  deter¬ 
mined  by  integrating  eqns  (4.1)  by  some  numerical  integration  scheme  like 

P  *~P  ul~iP‘+  l)w2-a/3j6f  ,  q  —  q  +[(fl'  2+l  ]u)b-pq  u>2-l-p  u/3|6<  , 

,  *  (44) 

r  «—  r  +[c  -pa  -qb  \6l , 

or  some  other  higher  order  scheme.  This  process  is  repeated  to  determine  the  course  of 
motion  uniquely  along  time  [19,  20],  During  this  process,  small  errors  at  each  step  may 
accumulate,  so  that  appropriate  modifications  are  necessary  once  in  a  while,  say,  by  the 
direct  method  described  earlier  or  some  other  source  of  information 

This  method  is  also  used  to  determine  the  surface  orientation  and  position  p.  q 
and  r  from  stereo  vision  without  using  point-to-point  correspondence.  If  we  move  the 
camera  by  /  in  the  negative  x -direction,  the  object  moves  by  l  in  the  z -direction  rela¬ 
tive  to  the  camera.  In  view  of  eqn  (4.2),  the  change  rate  dF[X\/dl  of  feature  F[X\  is 
equal  to  C„  [X  j.  Similarly,  Cb  [AT)  and  Ce  [A-]  are  directly  obtained  by  moving  the  cam¬ 
era  in  the  y-  and  the  z -direction  and  measuring  the  change  rate  of  feature  /’[A"].  (In 
practice,  of  course,  the  camera  need  not  be  moved  if  the  necessary  number  of  cameras 
are  appropriately  positioned  beforehand.)  Then,  the  first  three  of  eqns  (4.3)  provide  a 
set  of  simultaneous  equations  to  solve  for  p,  q  and  r ,  since  C,  [AT),  ....  C  [X]  are  also 
measured  on  the  image.  First,  p  and  q  are  given  as  a  solution  of 
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HMWJt  "Ji  r>  r>  r  m  wkm 


[c.mcm+jrC'mcm  C'\x\ct\x\+±c.\x\c%uc\ 

|^Ce(Jf]C5(X]+i-C»[A-]C7[A-]  Ce[X\Ct[X\+±.CtlX}CtlX)  Ld 

_  r fCc  [XlC^Xl+C,  |X1(C3[.V1+C8[X])'| 

-  [/cc  IX}C2[X]+C>  [x](c,[x]+c#[jr])J  ’ 


and  r  is  given  by 

!C\\X\-pC:,\X\-qC,\X\  ,  /CJ[X|-,Cl[X]-,C,|X|  , 

- - cHxi - ’ - - r  <481 

(If  we  use  more  than  three  independent  feature  functionals,  the  camera  need  be  moved 
in  only  one  direction,  say,  in  the  x  -direction  alone.  However,  this  does  not  seem  to  be 
feasible  in  view  of  noise  susceptibility.) 

In  the  orthographic  approximation  /  — »oo,  eqns  (4.3)  become 

c.  [.]=<? i[-l.  <?»  M-fftM.  <UH>, 

#[])>  (4.7) 

cWt[.]=c*[.]-c4(.], 

and  the  process  goes  similarly  except  that  c  is  not  determined,  as  is  obvious  for  ortho¬ 
graphic  projection.  If  the  feature  functionals  that  we  use  are  invariant  with  respect  to 
translations  as  in  (1)  and  (2)  of  the  previous  section,  only  three  such  features  are  neces¬ 
sary  to  compute  wt,  w*  and  w3,  which  in  turn  determine  the  trajectory  of  p  and  q  .  Fig. 
10  shows  the  trajectory  of  the  motion  of  Fig.  9  obtained  by  measuring  the  diameter  D  (0) 
[I9i.  However,  special  care  should  be  taken  when  p  =0  and  q  =0,  in  which  case  both 
CUl[Jf)  and  CUn[X\  vanish  and  hence  and  are  not  determined.  In  this  case,  we 
must  use  a  higher  order  expression  of  the  optical  flow  as  shown  in  (18,  19]. 


In  the  pseudo-orthographic  approximation,  the  process  goes  similarly  except  that 


Ce  I.j  of  eqns  (4.3)  is  replaced  by 

Cc\.\=-j^(C3[.^C6[.\).  (4.8) 
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APPENDIX  A 


If  we  substitute  eqns  (2.2)  in  eqns  (2.3),  we  obtain 

r  r  ...  f  (a+ih  ) 

0 — 

r , -p p,‘ 7*  ~-c.  it 

f  J-r  J 

■  prl-qb  ph  —qa  . 

.8  =  />  +  -i— - 1  ( <1  ~2-p  - —  . 

/  -er  f  -r 


(A  1) 


r  ■  _  1 

l\  -  - -*»'•! 


cp 


:  (  1  .  .  C1 
1 1  rwi 


f  ■  f(f-r)  '■  f  ‘  fif-r) 

If  we  put  r  =  u  —  ib  ,  P=p~i<i  and  IF  =u.'1-i-t  w.j,  these  equations  are  rewritten  as 


Putting 


R  +iT  —2^3-—~-P  (  IF  *  ) 

S=-iP(\V-±U0).  K=--L\V+-  cP 

f  f  f  if  +r 


f  +r 


H"=U-— (' 


the  above  equations  are  further  rewritten  as 


V=l±Lu0 

P\V"  ={2u>3-R  )-i(‘2c'+T), 
P\V'=iS  ,  c  'P  -i\V'= fl<  -~-U0. 


(A. 2) 


(A. 3) 


(A.4) 


(A. 5) 
(A  6) 


Since  l'  is  given  by  eqn  (A.4),  the  remaining  equations  are  the  equations  to  determine 
c' .  P  ,  IF'  and  ^3. 

First,  we  check  whether  c'=0  or  not,  If  so,  we  have  W'  —  i(fI\  -  U 0,  /  )  from  the 
second  of  eqns  (AG)  Then  P  =S  ,f(  f  K  -U  0/  f  )  from  the  first  We  can  conclude  c'—  0 
if  and  only  if  these  IF'  and  P  satisfy  PW*  ={'2ujs-R  )-iT  obtained  from  eqn  (A  5)  If 
this  is  satisfied  (within  a  certain  threshold),  *j3  is  given  by  v3=(/i>  -Re  PIP'*  )  2 

Suppose  we  have  already  checked  that  r'  is  not  zero.  The  first  ol  eqns  (A  G)  is 
rewritten  as  (r'/>)(~/H  ')  =  c'.S.  Hence,  eqns  (A. 6)  means  that  c'P  and  -/IF'  are  the 
two  roots  of  the  quadratic  equation 

X‘-LX  -  r'S  =0  (/.  =  /A  -Cn  /  ) 


Hence  P  and  IF'  are  ^iven  as  functions  of  r  '  In 


(A  7) 


P(c')  =  —'(L  ±VL'--\c'S  ).  ir»(c ')=—(/-.  ±VL-  I c'S  ) 
2  c  2 


(A  S) 


Then,  eqn  (A. 5)  gives  *c3  as  a  function  of  c '  by 

^3=1(7?  +Re[P(c')H’VTi).  (A. 9) 


and  the  equation  to  determine  c‘  is 

r'=-l(7’^Im;P(c')U'(r')';).  (A  10) 

Eqn  (A.  10)  defines  a  unique  equation  although  two  sets  of  solutions  exist  for  P  .  IE' 
and  u.’3.  To  see  this,  let  A'j  and  AT  be  the  two  roots  of  eqn  (A. 7).  If  we  choose 
P—Xx:c'  and  IF'  =  iAT,  we  have  Im[PIF,'j  = -ReiA'jA’  \,'c',  while  if  we  choose 
P=A'o,c'  and  ir'  =  /A'lt  we  have  ImjPIF''  j=-ReLV*A'oJ/ c Since 
Re  A'^Vo  =Re  A'*A\v,  ImlPlE'* !  of  eqn  (A. 10)  remains  the  same  for  both  cases. 

If  we  actually  substitute  eqns  (A  S)  in  eqn  (A. 10),  we  obtain 

\/l6|  5  |-c  ,  J-8Re  7.  J5  *]c'~\L  |4=-Sc  '--4  Tc  '  +  \L  ]-.  (A. 11) 

The  left-hand  side  is  a  smooth  concave  function  (or  a  constant  if  5=0)  passing  through 
(0.|/„  |‘).  while  the  right-hand  side  is' a  smooth  convex  quadratic  function  also  passing 
through  (0.|Z,  |‘)  (Fig,  A).  Since  we  know  that  c'j^O,  there  exists  a  single  unique  non¬ 
zero  solution  c ' 


If  we  take  the  squares  of  both  sides,  we  obtain  a  cubic  equation 


c TV* — ~(  7’*-|5  \2-[L  i")c  ’  —  Re  L  ~S  ‘\-T\L  |2)=0. 


(A,  12) 


From  Fig  A.  it  is  easy  to  see  that  this  cubic  equation  has  three  real  roots  and  that  the 
middle  one  is  the  desired  root  (The  other  two  roots  were  introduced  by  squaring  of 


both  sides.) 


APPENDIX  B 


Since  un=u  and  c0=6  .  we  only  need  to  determine  p  ,  q  .  -C) ,  u,2  and  *o:{.  (r 
are  indeterminate  due  to  orthography  )  If  we  substitute  eqns  (2 .5)  in  eqns  (2. 
obtain 

T  — p  -m,  /?  =2u ;3-/i  w,  -7  ww, 

S  —  uM~e  7  -  i  ( y  uj-y—p  u.q ). 

The  first  two  eciuations  are  combined  into  a  single  equation 

R  +lT  =2w'3-p  aq-< 1  j-'o-r-  *  (p  u,'o-  <i  _Cj). 

II  we  put  P  =p  —  <f/  and  II  ==^q-^/wt2.  the  equations  become 

PIF '  =2^3-(P  -etT  ),  P\V=iS. 

Since  !PU-*|  =  !PU'|,  the  right-hand  sides  must  have  the  same  modulus,  i  e 

(2^3-(P-tT))(2^3-(P-iT))=STs-T 

from  which  .c:!  is  given  by 

^!^ii7?±v/55*,r-) 

From  eqns  (Bd).  we  immediately  see  that  if  IF  and  P  are  a  solution  then 
k\\  and  P  k  where  k  is  an  arbitrary  non-zero  real  constant  Hence,  we  do  n 
generality  il  we  put  II  —k  expfargl  H  j).  w  here  k  is  an  indeterminate  scale  factor 
matins  P  from  'spi-  IB  3)  bv  taking  ratios  of  both  sides,  we  obtain 

IF  iS 

IF'  2^,-lP  -iT) 

Faking  tin-  argument,  of  both  sides  vields 


and  r 
d ) .  we 

(B  1) 

(B.2) 

(B  3) 

(B  d) 

(B  5) 

so  are 
ot  lose 
Id  Ii  m- 

( B  (i : 


•9) 


a 


2arg(  IK  )=^-+arg(5  )-arg(2w3-(/?  4-iT ))  (mod  27r), 


and  hence 


arg(  IK)=-^-+-^-arg(5 ) — ^-arg(2w3-(/?  +iT ))  (mod  ir). 

4  1  1 


However,  we  can  ignore  the  mod  it  by  allowing  the  scale  factor  k  to  be  negative.  Then, 
IK  is  given  by  the  second  of  eqns  (2.6).  Finally,  P  is  given  from  the  second  of  eqns  (B.3) 
by  P  =iS  /  IK ,  and  hence  it  is  written  as  in  eqns  (2.6). 


APPENDIX  C 

If  the  pseudo-orthographic  approximation  (2.7)  is  adopted,  eqns  (A. 6)  are  replaced 


PW'=iS ,  W  =if  K. 


Hence,  IK  is  explicitly  obtained,  and  P  —iS  /  IK'— 5 /(/ K -U0/  f  ).  The  remaining  w3 
and  c  are  given  from  eqn  (A. 5)  as 

^3=l(i?+Re;PU'''  i)I  c  =1-±1(  T +Im[PlK' * )).  (C.2) 


If  we  note  that 


c, 

PH  =-i.D  ■  — 7 -=“«*« 

/  /V  -  L  0/  / 


we  obtain  eqns  (2.8) 


APPENDIX  D 

Optical  (lows  are  observed  in  the  form  of  eqns  ('2.1)  with  respect  to  an  xy- 
coordinate  system  arbitrarily  fixed  on  the  image  plane.  The  choice  of  the  coordinate  sys¬ 
tem  is  completely  arbitrary.  Suppose  we  use  an  j'i/'- coord  in  ate  system  obtained  by 
rotating  the  xy  -coordinate  system  by  angle  0  counterclockwise.  Then,  the  optical  now- 
must  bear  the  same  form 


u'=«0VA  V+flV-K^V+FV)*'. 

v'^vo'  +  C'x'+D'y'+iE'x'+F'y  ')y'. 


(D  1) 


because  we  are  still  observing  the  rigid  motion  of  a  plane.  In  other  words,  the  optical 
How  is  form  invariant.  Here,  the  old  coordinates  x  ,y  and  the  new  coordinates  x',  y'  are 
related  by 
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(06) 


Eqns  (D.4),  (D.5)  and  (D.6)  are  a  linear  mapping  from  u0,  v0l  A  ,  D ,  C ,  D  ,  E ,  F 
to  ii o',  vj,  A',  D',  C',  D',  E',  F',  and  this  -napping  is  a  representation,  i.e.,  a 
homomorphism,  of  the  2D  rotation  group.  As  is  well  known  in  group  representation 
theory,  any  representation  is  reduced  to  one-dimensional  irreducible  representations  due 
to  Schur’s  lemma,  since  the  2D  rotation  group  is  compact  and  Abelian.  In  fact,  if  we 
define  U0,  T ,  R  and  5  as  eqns  (2.3),  the  above  mapping  is  rewritten  as 


V0'=e~ieU0,  T'=T,  /?'=/?, 


(07) 


S'=e--iBS,  K'=e~ieI\. 

As  Herman  Weyl  pointed  out,  irreducible  representations  describe  physical  quanti¬ 
ties  which  are  inherent  to  the  phenomenon  and  independent  of  the  choice  of  the  coordi¬ 
nate  system.  Indeed,  the  above  parameters  describe  geometrical  characteristics  of  the 
flow  itself  familiar  in  fluid  dynamics  as  is  stated  in  the  text.  In  particular,  T ,  R  and  S 
are  obtained  by  resolving  the  matrix  composed  of  A  ,  B ,  C  and  D  into  the  scalar  part, 
the  deviator  (or  traceless  symmetric)  part  and  the  antisymmetric  (or  skew)  part.  This  is 
not  a  coincidence;  according  to  the  general  theorem  of  Weyl,  all  irreducible  representa¬ 
tions  of  any  tensor  representation  of  SO  (n )  are  obtained  by  a  combination  of  these 
decomposition  processes. 


^1R 


Fig.  2.  (a)  Translation  by  («Oivo)-  (b)  Divergence  by  T  .  (c)  Rotation  by  R  .  (d)  Shearing  with 
h?  l=c*p(arg(S )/2)  and  Q^=iQn  as  axes  of  maximum  extension  and  compression,  respectively, 
(c)  Fanning  along  (E  ,F  ). 
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1/2  rf 


Fig.  4.  The  number  of  intersections  of  the  texture  of  Fig.  1  with  parallel  scanning  lines  of 
different  orientation,  the  spacing  being  1/22  of  the  side  of  the  square  frame.  The  data  are  nor¬ 
malized  so  that  the  average  is  1/2tt.  The  solid  curve  is  the  Fourier  approximation  up  to  the 
second  order. 
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Fig.  8.  Diameters  of  the  contours  C  and  C'  of  Fig.  7  for  different  orientations  -  white  circles  for 
C  and  black  dots  for  C'.  The  solid  curves  are  the  Fourier  approximation  up  to  the  second  order. 
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Fig.  10.  The  true  and  the  computed  trajectory  of  the  gradient  (p  ,q  )  obtained  by  measuring  the 
diameter  D  ( 0 )  of  the  contours  of  Fig.  9  at  10°  intervals. 
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